Model Predictive Control-Based Reinforcement Learning Using Expected Sarsa

نویسندگان

چکیده

Recent studies have shown the potential of Reinforcement Learning (RL) algorithms in tuning parameters Model Predictive Controllers (MPC), including weights cost function and unknown MPC model. However, a framework for easy straightforward implementation that allows training just few episodes overcoming need imposing extra constraints as required by state-of-the-art methods, is still missing. In this study, we present two implementations to achieve these goals. first approach, nonlinear plays role approximator an Expected Sarsa RL algorithm. second only considered approximator, while model are updated based on more classical system identification. order evaluate performance proposed algorithms, numerical simulations performed coupled tanks system. Then, both applied real their closed-loop convergence speed compared with each other. The results indicate allow MPCs over very episodes. Finally, also disturbance rejection ability methods demonstrated.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Data-Efficient Reinforcement Learning with Probabilistic Model Predictive Control

Trial-and-error based reinforcement learning (RL) has seen rapid advancements in recent times, especially with the advent of deep neural networks. However, the majority of autonomous RL algorithms require a large number of interactions with the environment. A large number of interactions may be impractical in many real-world applications, such as robotics, and many practical systems have to obe...

متن کامل

Model Predictive Control and Reinforcement Learning as Two Complementary Frameworks

Model predictive control (MPC) and reinforcement learning (RL) are two popular families of methods to control system dynamics. In their traditional setting, they formulate the control problem as a discrete-time optimal control problem and compute a suboptimal control policy. We present in this paper in a unified framework these two families of methods. We run for MPC and RL algorithms simulatio...

متن کامل

Learning-based Model Predictive Control for Safe Exploration and Reinforcement Learning

Learning-based methods have been successful in solving complex control tasks without significant prior knowledge about the system. However, these methods typically do not provide any safety guarantees, which prevents their use in safety-critical, real-world applications. In this paper, we present a learning-based model predictive control scheme that provides provable high-probability safety gua...

متن کامل

Reinforcement Learning Based PID Control of Wind Energy Conversion Systems

In this paper an adaptive PID controller for Wind Energy Conversion Systems (WECS) has been developed. Theadaptation technique applied to this controller is based on Reinforcement Learning (RL) theory. Nonlinearcharacteristics of wind variations as plant input, wind turbine structure and generator operational behaviordemand for high quality adaptive controller to ensure both robust stability an...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2022

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2022.3195530